Bottom-up radio: creating a new media format using living lab research

This study resulted in the creation of a new media format for urban youth, adopting a living lab-approach, as current studies have shown that this group is currently not reached with the contemporary media offer. Living lab research is a state-of-the art methodology that aims at involving end-users in the innovation process over a longer time span, combining both quantitative and qualitative research techniques and tools. In a first phase, a panel of urban youngsters was created using an intake survey (N=290). These data were analyzed resulting in three distinct types of urban youngsters. In a second phase, a qualitative research trajectory was organized in order to refine the three profiles and get an insight in their media use, digital skills, media preferences and needs with regards to the current media offer. Research methods during this phase included diary studies, participatory observation during workshops and probe research. In a third phase, co-creation sessions were organized with youngsters from the urban panel in order to get feedback on a concept that was iteratively developed during the first two phases of the project. Results show that mobile devices and social media are important for these urban youngsters and that most of these youngsters have quite some creative skills. Radio seems to be a less popular medium, although they spend a significant amount of time listening to music. Further, results show that these youngsters are in need of a platform which stimulates community building and offers a space to express their creativity. A third requirement for the development of a new media format that would meet the needs of these youngers is a format that provides space for local elements and niche markets. This all resulted in the launch of Chase, an urban, crowdsourced radio station

Social network profiles as information sources for adolescents' offline relations

This paper presents the results of a study concerning the use of online profile pages by adolescents to know more about “offline” friends and acquaintances. Previous research has indicated that social networking sites (SNSs) are used to gather information on new online contacts. However, several studies have demonstrated a substantial overlap between offline and online social networks. Hence, we question whether online connections are meaningful in gathering information on offline friends and acquaintances. First, the results indicate that a combination of passive uncertainty reduction (monitoring a target’s profile) and interactive uncertainty reduction (communication through the target’s profile) explains a considerable amount of variance in the level of uncertainty about both friends and acquaintances. More specifically, adolescents generally get to know much more about their acquaintances. Second, the results of online uncertainty reduction positively affect the degree of self-disclosure, which is imperative in building a solid friend relation. Furthermore, we find that uncertainty reduction strategies positively mediate the effect of social anxiety on the level of certainty about friends. This implies that socially anxious teenagers benefit from SNSs by getting the conditions right to build a more solid relation with their friends. Hence, we conclude that SNSs play a substantial role in today’s adolescents’ everyday interpersonal communication

Evaluation of the game development process of a location-based mobile game

There is a growing interest of government bodies and NGOs in using (serious) video games in awareness campaigns. Until now, however, little was known on how to set up such a campaign so as to effectively cater to the needs of different stakeholders including the target audience. Hence designing, developing and translating a game for educational purposes whilst balancing between fun and learning is a complex process, this paper aims to evaluate this by presenting a methodological framework for involving stakeholders in the design and development of a game-based awareness campaign based on a user-centered software design methodology and assesses its effectiveness in a concrete use case: the development of the location-based mobile game City Jam. The goal was to develop a game-based road safety campaign to confront adolescents with road traffic situations with the aim to positively influence road safety attitude and behavior. Mobile technologies offer new opportunities to embed digital game based learning by in different contexts. Given the nature of the road safety campaign, a location-based game format was chosen, aiming to facilitate learning by means of an extended three-way interaction (human interaction, game and context). Different user-centered design methods were deployed throughout several phases of the game development process: In phase one (the opportunity identification) a literature review was performed to investigate relevant fields for the game’s goal. In phase two (the game concept development) expert interviews and a focus groups were conducted with relevant stakeholders and in phase three (the game concept design) co-design sessions and a focus group resulted in a game design document. In phase four (game development and testing) the beta version of City jam was developed and tested in an iterative field testing design and resulted in the final game. Results obtained throughout the game development process provided us the opportunity to evaluate several major aspects. Firstly the impact of stakeholder involvement on the different phases of the design process and the final product resulted in a game that was tailored to the preferences and needs of the target group. Secondly translating the game concept into practice, such as game elements, proposed educational game elements, were evaluated based on the usability, playability principles and social and technological aspects. Benefits and challenges of user-centered design methods are discussed and how budget constraints and differing desired outcomes of different stakeholders challenge but also enrich the process

Social network profiles as information sources for adolescents' offline relations

This paper presents the results of a study concerning the use of profile pages by adolescents to get to know more about offline friends and acquaintances. Previous research has indicated that social network sites are used to gather information on new online contacts. However, several studies have demonstrated a substantial overlap between offline and online social networks. Hence, we question whether online profiles are meaningful in gathering information on these 'offline' friends and acquaintances. The results indicate that the combination of passive uncertainty reduction (monitoring a profile) and interactive uncertainty reduction (communication through a profile) explains certainty about both friends and acquaintances. Second, it shows that the results of online uncertainty reduction positively affect self-disclosure, which is imperative in building a solid friend relation. Furthermore, we find that uncertainty reduction strategies positively mediate the effect of social anxiety on the level of certainty about friends

A systematic literature review of methodology used to measure effectiveness in digital game-based learning

In recent years, a growing number of studies is being conducted into the effectiveness of digital game-based learning (DGBL). Despite this growing interest, however, it remains difficult to draw general conclusions due to the disparities in methods and reporting. Guidelines or a standardized procedure for conducting DGBL effectiveness research would allow to compare results across studies and provide well-founded and more generalizable evidence for the impact of DGBL. This study presents a first step in this process by mapping current practices through a systematic literature review. The review included peer-reviewed journal and conference publications between 2000 and 2012. Other inclusion criteria were that (1) the study’s primary aim was effectiveness measurement of cognitive learning outcomes, (2) the focus was on digital games and (3) a pre-post design with a control group was used. Twenty-five publications were found eligible for this study. Important differences were found in the number of control groups used and the type of intervention implemented in the control group (e.g. traditional classroom teaching, use of multimedia, computer-based learning, paper exercises, other games, or no intervention). Regarding the implementation method of the DGBL intervention in the experimental group, two approaches can be distinguished: stand-alone intervention or as part of a larger program. Moreover, a wide variety of effectiveness measures was used: measures for learning outcomes were complemented with time measurements and/or with self-reported measurements for self-efficacy and motivation. Learning effect calculation also varied, introducing pre-test scores in the analysis, conducting a separate analysis on pre- and post-test scores or conducting an analysis on difference scores. Our study thus indicates that a variety of methods is being used in DGBL effectiveness research opening a discussion regarding the potential and requirements for future procedural guidelines

Learning math as you play: comparing arithmetic performance enhancement induced by game play and paper exercises

One of the promises of video game training is that, compared to traditional training, it can be more engaging and entertaining (Boot et. al., 2008). However, besides entertainment, games have shown to have the potential to impact a larger variety of cognitive abilities. Previous research has consistently shown that several aspects in cognition such as visual short-memory, multitasking and spatial cognition can be enhanced by game play. In a previous study, we found that playing Monkey Tales, a commercial game aimed at training arithmetic skills in children, helped second grade pupils to increase their accuracy in mental calculation as compared to paper exercises or no exercises. The present study aimed to explore how arithmetic performance enhancement induced by game play and paper exercises differs. In order to do this, we compared the performance gains that second graders achieved in a computer test made for assessing their math skills. We performed a combined analysis of the changes in two behavioral measurements: accuracy and reaction times. Children were tested at two points in time: before and after the three week period. We compared the reaction times and the accuracy improvements between these two moments and compared different items types (e. g. understanding tenths, understanding hundreds, even or odd up to 100 among other types). We found indirect evidence suggesting that arithmetic performance enhancement induced by game play and paper exercises might rely on slightly different cognitive mechanisms

Pre-test session impact on the effectiveness assessment of a fire safety game

In recent years, critiques have been formulated regarding current evaluation methods of DGBL (digital game-based learning) effectiveness, putting the validity of certain results in doubt. An important point of discussion in DGBL effectiveness studies is whether or not a pre-test should be administered, as it can lead to practice effects and pre-test sensitization, threatening internal validity of the results. The present study aims at testing if the administration of a pre-test has a direct influence on post-test scores and/or makes participants more receptive to the intervention. For this purpose, an effectiveness study of a fire safety training in a hospital was conducted using a Solomon four-group design. The experimental groups received a game-based intervention (n= 65) of which 34 participants received a pre-test and 31 did not. The control groups received traditional classroom instruction (n=68), of which 39 participants received a pre-test and 29 did not. A 2x2 ANOVA was used to explore the practice effect and the interaction between the pre-test and the intervention. An interaction effect between pre-test and intervention is detected. More specifically, this interaction takes place in the traditional classroom group, indicating pre-test sensitization. In the traditional classroom context, the pre-test makes the participants more sensitive to the content treated in the intervention while administration of a pre-test does not influence outcomes of the DGBL treatment. When the administration of a pre-test influences the control group's receptivity to the treatment, but not the experimental group, results of an effectiveness study may be biased. This is especially relevant in the DGBL field as often, non-significant differences between DGBL and more traditional methods are reported. Therefore, further research should take this into account and look for possible solutions to solve this discrepancy

Best practices for deploying digital games for personal empowerment and social inclusion

Digital games are being increasingly used in initiatives to promote personal empowerment and social inclusion (PESI) of disadvantaged groups through learning and participation. There is a lack of knowledge regarding best practices, however. The literature on game-based learning insufficiently addresses the process and context of game-based practice and the diversity of contexts and intermediaries involved in PESI work. This paper takes an important step in addressing this knowledge gap using literature review, case studies, and expert consultation. Based on our findings, we formulate a set of best practices for different stakeholders who wish to set up a project using digital games for PESI. The seven cases in point are projects that represent various application domains of empowerment and inclusion. Case studies were conducted using documentation and interviews, covering background and business case, game format/technology, user groups, usage context, and impact assessment. They provide insight into each case’s strengths and weaknesses, allowing a meta-analysis of the important features and challenges of using digital games for PESI. This analysis was extended and validated through discussion at two expert workshops. Our study shows that a substantial challenge lies in selecting or designing a digital game that strikes a balance between enjoyment, learning and usability for the given use context. The particular needs of the target group and those that help implement the digital game require a highly specific approach. Projects benefit from letting both intermediaries and target groups contribute to the game design and use context. Furthermore, there is a need for multi-dimensional support to facilitate the use and development of game-based practice. Integrating game use in the operation of formal and informal intermediary support organiszations increases the chances at reaching, teaching and empowering those at risk of exclusion. The teachers, caregivers and counsellors involved in the implementation of a game-based approach, in turn can be helped through documentation and training, in combination with structural support